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Abstract 

Sampling  theorem  concepts  are  applied  to  certain  classes  of  linear 
shift  variant  systems.  Various  sampling  theorem  characterizations 
arise  from  different  bandlimiting  assumptions  on  the  system  input 
and/or  impulse  response.  These  characterizations  are  also  expressed 
in  discrete  form  and  in  all  cases  considered,  reduce  to  an  identical 
computational  form  which  can  be  evaluated  with  a generalized  Z trans- 
form treatment.  The  Fourier  duals  of  the  sampling  theorems,  wherein 
the  system  is  characterized  by  its  frequency  rather  than  impulse  re- 
sponse, are  also  presented. 


1 . INTRODUCTION 

Past  application  of  sampling  theorem  con- 
cepts to  linear  shift  variant  systems  has 
been  to  evaluate  the  system  impulse  re- 
sponse rather  than  to  characterize  the  in- 
put-output relationship  (1) , although  ade- 
quate sampling  rates  have  been  discussed 
briefly  (2).  In  this  paper,  on  the  other 
hand,  we  present  numerous  conditions  under 
which  the  superposition  integral  character- 
ization of  the  input-output  relation  for 
linear  shift  variant  systems  can  be  expres- 
sed in  sampling  theorem  type  expansions. 
Certain  ramifications  of  these  treatments, 
such  as  digital  characterization  of  the 
system  process  without  loss  of  information 
and  generalized  Z transform  treatment  of 
discrete  superposition  relations,  are  also 
discussed. 


In  section  2,  certain  preliminary  notational 
and  computational  conventions  are  given 
which  are  necessary  in  the  development  of 
the  sampling  theorems.  Sections  3 through 
5 present  three  different  sampling  theorems 
corresponding  to  various  bandlimiting  assum- 
ptions on  the  system  input  and/or  impulse 
response.  A direct  consequence  of  these 
sampling  theorems  are  infinite  matrix  char- 
acterizations of  the  system  process  which, 
except  for  sampling  rates,  are  identical 
for  all  three  sampling  theorems.  The  use 
of  the  Z transform  in  treating  these  dis- 
crete characterizations  is  briefly  discussed 
in  section  7.  In  section  8 the  Fourier  duals 
of  the  sampling  theorems  are  presented  where- 
in sampling  is  performed  in  the  frequency 
domain.  Section  9 contains  some  concluding 
remarks. 
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The  work  of  this  paper  was  motivated  by  in- 
vestigation of  space-variant  systems  en- 
countered in  coherent  optical  processing 

(3) .  Substantial  new  material,  however,  is 
presented  here.  We  note  that  causality  is 
not  a constraint  in  such  spatial  systems. 

For  this  reason,  the  sampling  theorems  here 
are  presented  for  the  more  general  case 
where  causality  is  not  -a  constraint.  Al- 
though a causal  signal  (zero  for  negative 
time)  can  never  be  rigorously  bandlimited 

(4)  , familiar  time-bandwidth  product  approx- 
imations can  be  applied  if  approxiate  (5) . 
The  same  is  true  for  the  system  impulse  re- 
sponse with  respect  to  its  first  variable. 
There  are  many  causal  signals  and  systems, 
however,  which  can  be  considered  "essential- 
ly* bandlimited.  Even  the  concept  of  a 
bandlimited  signal,  at  best,  can  only  be 
considered  as  an  approximation  to  real  world 
phenomena  (5). 

For  clarity  of  presentation,  attention  will 
be  restricted  to  one  dimension.  Generaliza- 
tion to  multidimensional  systems  is  straight- 
forward. 


(6) . For  example,  we  can  directly  express 
the  output  spectrum  by 


<3) 


Y(f>  - PtIy<t)i 

■ FTFtfh(t;x)u(T> ] |y_f 
where  the  Fourier  operators  are  defined  by 

^ts(tjT)  ] = jC  s(t;x)exp(-j2uft)d  t (4) 


and 


FTls(t;T)]“  / s(t;x)exp(-j2Trvx)dx 


(5) 


Note  that  for  the  shift  invariant  case  that 
h(t;x)  -+  h(t)  . Equation  3 then  takes  on  the 
familiar  product  form  Y(f)  = Ftlh(t) ]Ftlu(t) ) 

A transform  of  the  impulse  response  which 
will  be  of  interest  is  the  variation  spec- 
trum defined  as 


HT(t;v) 


FT(h(t;x)] 


(6) 


2.  PRELIMINARIES 

The  response,  y(t),  of  a linear  system  to 
an  input  u(t) , can  be  expressed  by  the  sup- 
erposition integral: 


y (t)  - S lu(t) ) 

m 

- / h(t-x;x)u(x)dx 


(1) 


where  S(-)  is  the  system  operator  and  the 
system  impulse  response  is  formally  defined 

as 


h(t-x;x)  - S (6 (t-x) ) 


(2) 


where  6(t)  denotes  the  Dirac  delta.  (For 
a causal  system,  h(t-xjx)  is  zero  for  t<x.) 
This  particular  choice  of  impulse  response 
notation  has  certain  computational  advantages 


The  support  of  the  variation  spectrum  is  a 
measure  of  the  manner  in  which  the  impulse 
response  changes  shape  with  respect  to  x . 

We  consider  here  the  low-pass  case  for  which 
HT(t;v)  is  identically  zero  outside  the  in- 
terval | v | < »v.  Such  systems  will  be  re- 
ferred to  as  variation  limited.  The  quan- 
tity 2Wy  is  appropriately  termed  the  varia- 
tion bandwidth . 

Note  that  a shift  invariant  system  has  a 
variation  bandwidth  of  zero  and  is  thus  truly 
invariant. 

3.  A SAMPLING  THEOREM  FOR  VARIATION 
LIMITED  SYSTEMS 

We  now  will  develop  a sampling  theorem  appli- 
cable to  variation  limited  systems  with  band- 
limited  inputs.  For  the  bandlimited  input, 
we  again  consider  the  low-pass  case  where 
u(t)  has  bandwidth  2N  . Consider,  then, 


Sactlos 

action 


a 


the  term  h(t;x)u(T)  which  is  the  argument  of 


the  Fourier  operator  in  Eq.  3-  Multiplica- 
tion in  the  t domain  corresponds  to  convolu- 
tion in  the  v domain.  As  such,  if  u(i)  has 
bandwidth  2Wy  and  h(t;T)  has  a variation 
bandwidth  of  2Wv>  then  their  product  will 
have  a bandwidth  2Wg  equal  to  the  sum  of 
the  component  bandwidths : 

2Ws  = 2Wy  + 2Wu  (7) 

The  product  h(t;t)u(T)  can  thus  be  expanded 
in  a uniformaly  converging  (7)  Whittaker- 
Shannon  sampling  theorem  (8)  in  t : 

h(t;T)u(r)  = l h(t,-Tn)u(Tn)  • 
n 

• sine  2W  (t-t  ) (8) 

s n 


of  shift  invariant  systems  each  of  which 
corresponds  to  a sample  impulse  response. 
The  switching  mechanism  required  to  feed 
each  filter  its  corresponding  sample  value 
is  representative  of  the  shift  variance  of 
the  overall  system.  Note  that  Eq.  11  is 
not  optimal  in  the  sense  of  utilizing  mini- 
mum sampling  rates.  That  is,  u(t)  only  re- 
quires a sampling  rate  of  2WU  and  h(t;T)  a 
sampling  rate  of  2V»v  in  t . Both  are  here 
being  sampled  at  a rate  2Ws.  The  authors 
have  shown  however,  that  the  sampling  ex- 
pansion utilizing  the  minimum  allowable 
sampling  rates  is  computationally  less 
attractive  (3) . 

4.  AN  ALTERNATE  SAMPLING  THEOREM 


where  t * n/2W  and  sine  x A sinnx/irx. 
n s 

Substituting  into  Eq.  3 and  simplifying 
gives 


V(f)  = y Ht(f,Tn)u(Tn) 


x exp  (- j2xf  Tn>  G (jjj- ) 


(9) 


where  our  transfer  function  is  defined  by 


Hfc  ( f ; T ) A Ftlh(t;-r)] 


(10) 


In  the  previous  section,  h(t;t)  was  assumed 
to  be  bandlimited  in  t.  Note  that  this 
restriction  does  not  necessarily  assure  that 
h(t-t;T)  is  also  bandlimited  in  t.  As  such, 
we  can  derive  an  alternate  sampling  theorem 
for  the  case  where  Ft[h(t-T;t) ) is  zero  out- 
side of  the  interval  |v|  < W^.  If  our  input 
has  bandwidth  2Wu,  then  the  product  h(t-T;t) 

u(t)  has  bandwidth  2W.  = 2W  + 2W.  in  t and 

a u n 

can  be  expressed  in  the  sampling  theorem  ex- 
pansion: 


and  G(f)  * Ft(sinc  t)  is  the  gate  function. 
Inverse  Fourier  transforming  Eq.  9 gives 


h(t-T,-T)  « yh(t-Tnjtn)u(tn)sinc2Wd(T-Tn) 

n 

(12) 


y (t)  » y h(t-Tn;Tn)u(Tn)*sinc  2Wg  t 
n 

(id 

where  denotes  the  convolution  operation 
We  interpret  Eq.  11  as  follows:  For  band- 
limited  inputs,  the  output  to  a variation 
limited  system  can  be  computed  by  1)  samp- 
ling the  input,  2)  multiplying  each  input 
sample  by  its  corresponding  sample  impulse 
response,  3)  sunning  the  results,  4)  pass- 
ing the  sum  through  a suitable  low-pass 
filter.  As  is  shown  in  Figure  1,  we  can 
interpret  this  result  as  the  representation 
of  a variation  limited  system  by  a bank  of 


where,  here,  tn  * n/2Wd>  Substituting  into 
the  superposition  integral  [Eq.  1]  gives 

oo 

y ( t)  - y h<t-Tn*Tn)u<'tn)  / sinc2Wd(T-xn)dt 
n — 

“ 5^7  I h<t-VTn>u<Tn>  <13> 

a n 

Our  expansion  here  is  similar  to  that  in  Eq. 

11  except  for  the  sampling  rate  and  the  fact 
that  no  low-pass  filtering  is  required. 

Note  also,  due  to  our  bandlimiting  constraints 
the  output  in  Eq.  13  is  bandlimited  with  band- 
width 2Wd. 


5.  A THIRD  SAMPLING  THEOREM 


to  give  the  corresponding  system  output 


The  sampling  theorems  thus  far  discussed 
require  sampling  in  the  t or  input  domain. 

An  alternate  sampling  theorem  which  utilizes 
output  sampling  occurs  when  h(t;x)  is  band- 
limited  in  t with  (lowpass)  bandwidth  of, 
say,  2Wfc.  (Note  that  this  condition  is 
equivalent  to  h(t-T;T)  being  bandlimited  in 
t.)  Such  a condition  holds  when  the  system 
response  to  an  impulse  input  is  bandlimit- 
ed irrespective  of  the  location  of  the  in- 
put delta  function.  Under  this  bandlimited 
assumption,  we  can  immediately  express  the 
impulse  response  in  the  sampling  theorem 
expansion: 

h(tjx)  - y h(t  ; x) sinc2W  (t-t  ) (14) 

n t n 

n 

where  tn  » n/2Wt<  Substituting  into  Eq.  3 
followed  by  simplification,  leaves 


6.  DISCRETE  CHARACTERIZATION 

Inspection  of  the  three  sampling  theorems 
thus  far  presented  reveals  that  the  corres- 
ponding system  output  is  bandlimited  and 
thus  can  also  be  expressed  in  a sampling 
theorem  expansion.  We  now  investigate 
direct  computation  of  the  required  output 
sample  values  in  terms  of  the  sampled  input 
and  impulse  response.  The  resulting  com- 
putational forms,  in  the  three  cases  consid- 
ered, are  identical. 

(1)  Consider  first,  the  variation  limited 
system  with  bandlimited  input.  From  Eq.  11, 
we  define  the  low-passed  system  impulse  re- 
sponse as 


h(t-Tn;Tn)  A 2Wsh(t-Tn;Tn)*sinc2Wst  (17) 


Y(f)  “ -stj-  l FTIh(t  ;t)u(t)J  Equation  11  can  now  be  written 

zyltn  n v-f 


exp(-j2*ftn)G(2^) 

Inverse  transforming  yields: 


y(t)  « l h(tnst-tn)u(t-tn)*sinc2Wtt 


As  before  we  have  reduced  the  system  char- 
acterization to  a summation  of  convolutions. 
In  this  case,  however,  we  do  not  have  to 
place  any  bandlimiting  constraints  on  our 
input. 

We  can  interpret  Eq.  16  as  shown  in  Figure 
2.  Our  input  is  fed  into  a tapped  delay 
line  which  serves  as  the  shift  variance  of 
the  overall  system.  The  outputs  at  various 
points  along  the  delay  line  are  then  multi- 
plied by  the  appropriate  sample  responses. 
All  these  products  are  then  summed  and  pas- 
sed through  an  appropriate  low  pass  filter 


y«t>  - 3*T  I h(t“VVu(ln) 


It  follows  immediately  that 


*(tm>  “ ST  l h(tm-Wu<Tn>  (19) 

s n 

From  Eq.  9,  y(t)  has  a bandwidth  of  2Wg. 

Thus,  we  require  that  t *=  m/2W  . Note 

in  s 

that  Eq.  19  can  be  straightforwardly  expres- 
sed in  an  infinite  matrix  form. 


Suppose  we  now  make  the  additional  constraint 
that  h(t;x)  is  bandlimited  in  t with  band- 
width 2W^.  If  Ws  > Wfc,  then  the  low-passed 
impulse  response  in  Eq.  17  is  the  same  as 
our  actual  impulse  response: 


h(t  -VV  - h<t-VTn)  , W,  > *t  (20) 


Then,  Eq.  19  becomes 


n/2Ws. 


and  25]  feveals  computationally  identical 

y(tm>  • 2 £ ^*tm~Tn;Tn^u*Tn* ' Ws>Wt  forms.  Our  assumptions  is  all  cases  are  (1) 

S n (21)  u(t)  is  bandlimited,  (2)  either  h(t;x)  or 

where  t = t = n/2W  . h(t-T}T)  is  bandlimited  in  x and,  for  the 

(2)  Consider  "next  the  sampling  theorem  in  first  lE<3-  21>  and  third  lE<3-  251  ca8es’ 

section  IV  where  h<t-x;x)  is  bandlimited  in  that  (3)  h(t;T>  [and  thus  h(t-x;x)]  is  band- 
x.  Since  the  output  has  bandwidth  2Wd,  it  limited  in  Ke  can  combine  the  three  dis- 

f ol lows  immediately  from  Eq.  13  that  the  crete  matrix  type  relationships  into  a 

desired  output  sample  values  are  given  by  single  expression: 

y(t>  “ 7C-  l h(t  -x  ;x  )u(x  * (22)  y,tm)  * 2W~  ^ h * tm“Tn  *’  Tn)  U ( Tn  * <26) 

n in  n n n n 

where,  now  t = x = n/2W. . where 

n n a 

(3)  Lastly,  consider  the  sampling  theorem 

expansion  in  Eq.  16  where  the  output  has  w = minfWd'  max(Wt,  Wg)  ] (27) 

bandwidth  2Wfc.  The  corresponding  mt*1  out- 
put sample  here  is  given  by:  and  t = x = n/2W.  We  again  stress,  that 


crete  matrix  type  relationships  into  a 
single  expression: 

y(tm>  “ ST  I h(VTn,Tn)u(Tn) 
where 


W = min[W. , max(W.  , W_) ] 
a Z S 


y(tm)  = l Ih(tn;t)u  (t)  *sinc  2Wtt) 


where,  now,  t = m/2W^ . 

m z 

A more  computationally  attractive  form  of 
Eq.  23  occurs  when,  in  addition  to  being 
bandlimited  in  t,  the  system  is  variation 
limited  and  the  input  is  bandlimited  such 
that  2Wg  < 2wfc.  In  this  case  Eq.  15  be- 


Y(f)  - 5^  l Ftlh(tn;t)u(t)] 

x exp(-j2*ft  )G(,|-)G(,£-> 
t s 

1 r <24) 

= ^ I Ft[h(tn;t)u(t)] 
exp(-j2nftn) > Wg  < 

Inverse  transforming  and  evaluating  at  t« 
t gives 

III 

y'V  “ 2iT  l h(VWu(Tn)!  V Wt 


and  t = x = n/2W.  We  again  stress,  that 
n n 

in  all  cases  considered,  sampling  of  both 
the  input  and  impulse  response  is  performed 
t tm  ^n  at  a rate  above  the  required  minimum  allow- 

(23)  able  sampling  rate. 

orm  of  7.  Z TRANSFORM  TREATMENT 

being 

iation  For  shift  invariant  systems,  Eq.  26  takes 
id  such  on  the  form  of  a discrete  convolution  which 

5 be-  is  traditionally  treated  with  the  Z trans- 

form (8).  We  will  now  show  that  due  to  our 
choice  of  impulse  response  notation,  such 
treatment  can  be  generalized  to  the  shift 
variant  case. 

(24)  We  define  two  Z transforms  of  a two  variable 
discrete  sequence  s(m,n)  by 


Zn(s(m,n))  « ]z~n  s (m,n) 


Z^lstm.n)]  - £ z""1  s (m,n)  (29) 

m 

Note  the  similarity  of  the  spirit  of  these 
definitions  to  the  Fourier  transform  oper- 


where  tn  - xfl  - n/2Wfc.  oetinitions  to  tne  Fou 
Inspection  of  the  results  of  the  three  dis-  ati°n8  *n  Eqs.  4 and  5 
crete  characterizations  above  (Eqs.  21,  22 


Denote  the  Z transform  of  yl^)  by  Y ( z ) . 
From  Eq.  26,  it  follows  that 

hz)  - zmty(tm)i 

“ 5W  I II  z"mh<tm-TnJTn)lu(Tn) 

n in 

■J5lzsih<VVll'nu(V  (30> 

n 

“ 5W  ZnZmIh(tni;Tn)utTn)  1 
n m m n n 

This  is  the  generalized  Z transform  treat- 
ment of  a discrete  shift  variant  process. 
Note,  as  was  in  the  case  with  Eq.  3 the 
result  reduces  to  the  more  familiar  product 
form  for  the  shift  invariant  case. 

8.  FOURIER  DUAL  SAMPLING  THEOREMS 

The  sampling  theorems  thus  far  presented 
can  also  be  applied  in  a Fourier  dual  sense 
to  the  frequency  domain.  The  corresponding 
constraints  here,  take  on  a physically  dif- 
ferent meaning  and  thus  widen  the  class  of 
systems  which  can  be  characterized  in  samp- 
ling theorem  type  expansions. 

To  change  the  computational  form  of  the 
superposition  integral,  we  apply  Parseval's 
theorem  to  Eq.  1: 

y(t)  - J“k(t-cviv)U(v)dv  (31) 

— «D 

where  U(v)  • FtIu(t)1  and 
k1t-cv;v)  - Jm  h (t-t ; t) exp ( j2«VT)dt  (32) 

—m 

The  kernel,  k(*,*)  is  recognised  as  the 
system  frequency  response: 

k(t-cv;v)  - S(exp( j2irvt)  1 (33) 

The  constant  c is  included  simply  to  main- 
tain dimensional  consistency  between  the 
time  variable  t and  frequency  variable  v. 


(1)  Consider  first  the  Fourier  dual  of  the 
sampling  theorem  for  variation  limited 
systems.  Here,  we  require  that  F^lMtjv)) 
be  identically  zero  outside  the  interval 
lTl  1 Tv*  Also  U(v)  must  be  "band limited. " 
That  is,  our  input,  u(t),  must  be  nonzero 
only  over  the  interval  |t|  < Tu>  The  re- 
sulting sampling  theorem,  then,  is  simply 
the  Fourier  dual  of  Eq.  11: 

y(t)  * : J k (t-cv  iv  )U (v  ) *sinc(2T  t/c) 

C si  la  n 8 

(34) 

where  2Tg  « 2TU  + 2Ty  and  vR  « n/2Tg. 

(2)  Consider  next  the  Fourier  dual  of  the 
sampling  theorem  in  section  4.  Here,  we 
require  F”1 [k (t-cv;v) J is  zero  for  |t|  > Th 
and,  again,  that  u(t)  is  zero  for  |t|  > Tu. 
The  Fourier  dual  of  the  sampling  theorem 

in  Eq.  13  follows  immediately  as 

y(t)  * 3^-  l k(t-cvn;vn)U(vn)  (35) 

d n 

where  2Td  “ 2Th  + 2Tu  and  vn  « n/2Tj. 

(3)  Lastly,  we  inspect  the  Fourier  dual  of 
the  sampling  theorem  presented  in  section  5. 
Our  constraint  in  this  case  is  that  k(t,v) 
is  bandlimited  in  t with  bandwidth  2Wt< 

Note  that  this  constraint  is  the  same  as  re- 
quiring h(t;T  ) to  be  bandlimited  in  t. 

The  resulting  sampling  theorem  expansion 
corresponding  to  Eq.  16  is 

l t-t  t-t 

y(t)  - | l k(tn;  1 U(-5-^*sinc2Wtt 

" (36) 

where  t * n/2W. . 

n t 

The  three  sampling  theorems  presented  here 
can  obviously  be  placed  in  discrete  form  as 
was  done  in  section  6.  For  brevity,  these 
discrete  cases  will  not  be  presented  but 
can  be  straightforwardly  derived  utilising 
previous  notions. 
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9.  CONCLUSIONS 

We  have  presented  several  sampling  theorems 
applicable  to  various  classes  of  shift  var- 
iant systems  envolving  certain  bandlimit- 
ing  constraints  on  the  system  impulse  re- 
sponse and/or  input.  The  system  output, 
in  certain  instances,  is  bandlimited  and 
the  computational  form  required  to  evaluate 
the  values  for  its  sampling  theorem  ex- 
pansion was  shown  to  result  in  an  infinite 
matrix  relation.  The  computational  forms 
in  each  of  the  three  cases  considered  are 
identical  differing  only  in  sampling  rate. 

The  matrix  type  relationship  was  shown  to  (5) 
be  able  to  be  evaluated  in  a generalized  Z 
transform  treatment.  Fourier  duals  of  the 
sampling  theorem,  where  sampling  is  largely  (6) 
performed  in  the  frequency  domain,  were  al- 
so presented.  Possible  areas  of  applica- 
tion of  the  sampling  theorems  include  sig- 
nal and  image  processing  as  well  as  shift 
variant  system  synthesis  with  a number  of 
shift  invariant  systems  and/or  tapped  de- 
lay lines.  Investigation  into  implementa- 
tion of  the  sampling  theorems  with  coherent 
optical  processors  is  also  presently  under 
way  (9).' 
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An  implementation  of  the  sampling  theorem  presented  in 
section  5.  Delayed  versions  of  the  input  are  multiplied 
by  corresponding  sample  impulse  responses,  summed,  and 
passed  through  a low  pass  filter  to  give  the  output  of  the 
parent  shift  variant  system. 


Figure  2: 
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